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PROTOCOL DATA UNIT PRIORITIZATION IN A DATA PROCESSING NETWORK 

RELATED APPLICATIONS 
The subject matter disclosed in each of the following appUcations is related: Rawson, 
Combining Network Management Information with Application Information on a Computer 
Network, Docket No. AUS920000520US1; Rawson, Polling for and Transfer of Protocol Data 
Units in a Data Processing Network, Docket No. AUS920000516US1; and Rawson, Protocol 
Data Unit Prioritization in a Data Processing Network; Docket No. AUS920000522US1. 



10 BACKGROUND 
1 . Field of the Present Invention 



i-=i 



fU 



lU 



The present invention generally relates to the field of data processing networks and more 
particularly to managing servers in a network using a single physical network while minimizing 
bandwidth consumption attributable to the management process. 

2. History of Related Art 



2fe In the field of data processing networks, a local network, such as an Ethernet network, is 

frequently connected to an extemal network, such as the Intemet, through a router, hub, or other 
network-dispatching device. The local area network itself may include a significant number of 
data processing devices or server appliances that are interconnected through a central switch. 
The server appliances may receive the bulk of their data processing requests from the extemal 

25 network. 

When large numbers of server appUances are connected to a common switch and 
providing critical services such as running web-based applications, they must be managed at 
minimum cost and with a minimum of additional hardware and cabling. Using a single network 
for both management and applications is therefore desirable. Unfortunately, using a common 
30 network with limited bandwidth for apphcation and data traffic as well as management traffic 
may result in decreased application performance. It is therefore desirable to reduce the overhead 
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associated with management tasks in a network environment. It is further desirable if the 
implemented solution is compatible, to the greatest extent possible, with existing network 
protocols to minimize time and expense. 

In addition, traditional networks typically require the periodic gathering of management 
5 information. This periodic information retrieval has generally been inefficiently achieved by 
configuring an alarm and programming one or more processors to respond to the alarm by 
sending management information on the network. Typically, this polled information travels over 
the network using the same logical path (same communication protocol) as the application 
packets thereby resulting in imnecessary delays and complexity due to the nature of 
10 communication protocols and the inherent operation of the local area network. It would 
desirable to improve upon the efficiency with which this periodically information retrieval is 
Q handled. Moreover, traditional networks have typically not implemented methods to prioritize 
J packets efficiently despite the advent of protocol standards that explicitly define prioritization 



resources. It would be desirable to use such resources to provide a method of beneficially 
l^S^I differentiating different types of packets fi*om one another and implementing transmission and 

i:ri 

^^y mterrupt priorities based on such differences. 



methods of transmitting protocol data imits (PDU) as disclosed herein. The network includes a 
first server including a first network interface card (NIC) that coimects the first server to a central 
switch. The network further includes a second server including a second network interface card 
(NIC) that connects the second server to the central switch. The first NIC is configured to store a 
25 first PDU in a buffer upon determining that the first PDU is of a first type and to combine the 

first PDU stored in the buffer with a second PDU of a second type upon determining that the first 
and second PDU share a common target. The combined PDU is then forwarded to the common 
target as a single PDU thereby reducing the number of PDUs traversing the network. 



30 server and application PDUs from an external network. The NIC may be configured to interpret 
priority information in the management and application PDUs and enabled to prioritize interrupts 



SUMMARY OF THE INVENTION 




The problem identified above is addressed by a data processing network and associated 



In one embodiment, the second server NIC receives management PDUs firom the first 
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to a host processor of the second server based upon the priority information. The management 
PDUs may be generated at a low level of the network's communication protocol stack. The 
communication protocol stack may comprise a TCP/IP protocol stack. The application PDUs are 
typically TCP/IP compliant while the management PDUs are generated at a data link level of the 

5 stack. The priority information may be contained within an IEEE 802. Iq compliant header of 
the PDUs. The second server is typically configured to grant higher priority to application PDUs 
than management PDUs. The NIC may be configured to buffer management PDUs until a 
management PDU interrupt is issued. The second server NIC may be fiirther configured to issue 
management PDU interrupts after detecting an absence of management PDU activity for a 

1 0 predetermined interval. 

In another embodiment, a NIC of the first server is configured to send a low level polling 

P| request to the second server NIC and the second server NIC is configured to respond to the 

!'^' polling request with a low level transfer of the buffered information to the first server NIC. The 

SI first server may comprise a dedicated management server and the second server may comprise a 

in 

15i server appliance configured to receive processing requests fi:om an extemal network. The 
network may include a plurality of additional server appliances, each attached to the central 
H switch, where the management server is configured to manage each of the server appliances, 
ill The first server NIC may be configured to broadcast the polling request to each of the server 
appliances on the network. The first server NIC may be configured to send the polling request in 
2Q3 response to the expiration of a timer. 



BRIEF DESCRIPTION OF THE DRAWINGS 



25 Other objects and advantages of the invention will become apparent upon reading the 

following detailed description and upon reference to the accompanying drawings in which: 

FIG 1 is a block diagram of selected elements of a data processing network according to 
an embodiment of the present invention; 

FIG 2 is a block diagram of selected elements of an exemplary server appliance suitable 
30 for use in the data processing network of FIG 1 ; 
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FIG 3 is a block diagram of selected features emphasizing the network interface card of a 
management server suitable for use in the data processing network of FIG 1; 

FIGs 4A, 4B, and 4C are conceptual representations of a management protocol data unit, 
an application protocol data unit, and a combined protocol data unit respectively according to 
one embodiment of the invention; 

FIG 5 is a flow diagram illustrating a method of combining management and application 
information to optimize bandwidth consumption in a data processing network according to one 
embodiment of the invention; 

FIG 6 is a block diagram illustrating selected features of network interface cards suitable 
for use in an embodiment of the invention that includes automated, low-level polling to gather 
management information; 

FIG 7 are flow diagrams illustrating the operation of an automated, low-level polling 
embodiment of the invention; 

FIGs 8A and 8B are conceptual representations of an protocol data unit format suitable 
for use with an embodiment of the invention emphasizing packet prioritization; and 

FIG 9 is a conceptual representation of a buffer suitable for use with the packet 
prioritization embodiment of the invention. 

While the invention is susceptible to various modifications and alternative forms, specific 
embodiments thereof are shown by way of example in the drawings and will herein be described 
in detail It should be imderstood, however, that the drawings and detailed description presented 
herein are not intended to limit the invention to the particular embodiment disclosed, but on the 
contrary, the intention is to cover all modifications, equivalents, and alternatives falling within 
the spirit and scope of the present invention as defined by the appended claims. 



Tuming now to the drawings, FIG 1 illustrates selected features of a data processing 
network 100 according to one embodiment of the present invention. In the depicted 
embodiment, network 100 includes a set of servers, referred to herein as server appliance(s) 101, 
that are connected to a central switch 130. Switch 130 is connected to an extemal network 102. 
The extemal network 102 may represent the Internet for an application in which network 100 is 



DETAILED DESCRIPTION OF THE INVENTION 
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providing web-based services. A network-dispatching device 120 is used to control the flow of 
incoming work from external network 120. 

Referring to FIG 2, a block diagram of a typical server appliance 101 is presented. In the 
depicted embodiment, server appliance 101 includes one or more processors 202 that are 
connected to a memory 204 via a processor bus 206. A bus bridge 209 connects an I/O bus 208 
to processor bus 206. A network interface card (NIC) 210 connected to I/O bus 208 enables 
server appliance 208 to connect to and communicate with central switch 130. I/O bus 208 may 
comply with any of a variety of legacy I/O protocols such as PCI and PCI-X. Ahematively, 
server appliance 101 may support emerging I/O subsystem architectures such as the InfiniBand™ 
architecture developed by the InfiniBand Trade Association. The InfiniBand architecture uses 
channel based point-to-point connections rather than the shared bus, load-and-store configiiration 
of PCI and its predecessors. Server appliances 101 may be implemented with a streamlined set 
of hardware and may be distinguished from traditional servers by the lack of various components 
typically found in conventional server boxes such as hard disks and graphics cards. 

Returning now to FIG 1, the depicted embodiment of network 100 fiirther includes 
permanent mass storage identified as network attached storage (NAS) 140. NAS 140 is a well- 
known type of device that typically includes a network interface connected to multiple disk 
drives. The network interface of NAS 140 may export a file system that enables the network 
servers to access data. The F700 and F800 series of filer boxers from Network Appliance, Inc. 
are examples of devices suitable for use as NAS 140. 

Network 100 may fiirther include a management server 110 connected to central switch 
130. As its name, impUes, management server 110 is a dedicated server responsible for 
managing network 100 (including server appliances 101 and NAS 140). For purposes of this 
disclosure, typical management tasks include tasks associated with the deployment and 
configuration of server appliances 101, the installation of software and hardware upgrades, 
monitoring and managing network performance, security, failures, and storage capacity, and 
other statistical gathering and analysis tasks. 

Theoretically, each server appliance 101 may operate with its own execution 
environment. More specifically, each server appliance 101 may have its own instance of the 
operating system (OS), network communication protocol, and hardware layer. In a typical web 
based server environment, each layer of the communication protocol may add its own header or 
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trailer with information, including destination address information, that is determined by the 
layer's specification. Perhaps the most commonly encoimtered commimication protocol is the 
transmission control protocol/internet protocol (TCP/IP) suite of protocols, which provide the 
foundation and framework for many computer networks including the Internet. TCP/IP is 
5 extensively dociunented in a variety of publications including M. Murhammer et al., TCP/IP 
Tutorial and Technical Overview, available online at www.redbooks.ibm.com (#GG24-3376-05) 
and incorporated by reference herein. In a TCP/IP network, a TCP header and an EP header are 
pre-pended to a packet as the packet moves down the protocol stack. A media access control 
(MAC) header is typically pre-pended to each packet before the packet reaches the physical layer 
10 (i.e., the network hardware). The MAC header includes the network address of the target device. 

Because each device in network 100 is directly connected to switch 130, each device has a 
O unique MAC address. The NIC 210 of each server appUance 101, for example, has a unique 
;j MAC address. Thus, NIC 310 can determine the target of a packet from the packet's MAC 



address. 

From the perspective of providing web-based services to multiple customers, multiple 
py execution environments may be desirable to implement one or more applications. From the 
perspective of managing network 100, however, a multiplicity of server appliances is difficult to 



ru accommodate. If the number of server appliances is significant (more than approximately five), 
administering each appliance server 101 separately is cumbersome, inefficient, and time 
2G9 consuming. 

Network 100 addresses the overhead associated with managing a heterogeneous set of 
server appliances by providing a dedicated management server 110 that presents a single system 
image for network management purposes. Using a conventional web browser to access this 
single image, management of each of the server appliances can be accomplished fi'om a single 

25 point. In one embodiment, management server 110 includes a server appliance manager that 
communicates directly with each server appliance 101. The server appliance manager generates 
code in a neutral language, such as extended markup language (XML), that is communicated to 
an agent associated with and customized for an organization management system (OMS). The 
OMS converts the XML code to a format suitable for use with each OMS. In this manner, a 

30 web-based application provider can lease specific server appliances 101 to various organizations 
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and allow each organization to manage its own leased appliance, using its own OMS, through a 
common server. 

As indicated in FIG 1, management server 110 is locally connected to each server 
appliance 101 and to NAS 140 through switch 130. In this embodiment, management 
5 information traveling to and from management server 110 travels over the same physical 
network as application and data packets. This design is contrasted with a conventional design in 
which management information may be transmitted over a physically distinct medium such as a 
serial bus that connects service processors of each network device. While sharing a common 
medium simplifies the design of network 100, it necessitates the sharing of finite network 
0 bandwidth between application packets and management information. For purposes of this 
disclosure, the term protocol data unit (PDU) is used generally to identify packets or frames and 
5 a distinction is made between management PDUs and application PDUs. Since the purpose of 
network 100 is to provide application services, it is highly undesirable if significant bandwidth is 
"i required to transmit "non-application" PDUs, i.e., management PDUs. Thus, one embodiment of 
^1 the present invention contemplates minimizing management PDU bandwidth consumption. 
\l Network 100 is preferably implemented with a high bandwidth network such as Gigabit 

Ethemet as specified in IEEE 802.3, which is incorporated by reference herein. Gigabit Ethernet 



supports the use of traditional PDU sizes of 1460 octets (bytes) as well as the use of jumbo PDU 
■;ri sizes of 9022 octets. In many appUcations, it may be reasonable to assume that the size of at 



20==; least some PDUs transmitted over the network is less than the maximimi transmission unit 
(MTU), especially for networks that support jumbo PDUs. A PDU that is smaller than the MTU 
is referred to herein as an eligible PDU. 

One embodiment of the present invention contemplates minimizing the bandwidth 
consumed by management PDUs by using available space in eligible application PDUs to "piggy 

25 back" management information into an existing PDU upon determining that the management 
PDU and the application PDU share a common network destination or target. By using a single 
PDU to transmit both management information and application information, the number of 
PDUs is transmitted over the network is reduced. Since PDUs must be separated from each 
other by transmission gaps that represent wasted bandwidth, performance is maximized by 

30 transmitting fewer and larger PDUs. 
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Turning now to FIG 3, a block diagram of management server 1 10 is depicted to illustrate 
selected features of the server according to one embodiment the invention. Management server 
110 has a core 302 that includes one or more processors, a memory connected to the processor(s) 
via a processor/memory bus, and a bus bridge that connects an I/O bus to the processor memory 
bus. The management server core architecture may be equivalent or substantially similar to the 
architecture of the exemplary server appliance 101 depicted in and described with respect to FIG 
2. The core 302 of management server 110 provides an I/O bus 304 to which a network interface 
card (NIC) 310 is connected. NIC 310 enables communication between management server 110 
and network switch 130 (not depicted in FIG 3). 

NIC 310 typically includes its own processor 312, a non-volatile storage device such as a 
flash memory 314, and a dynamic storage facility (RAM) identified as buffer 320. NIC 310 may 
further include sufficient scratch memory (not depicted) to modify PDUs as described below. 
Flash memory 314 includes one or more programs, each comprising a sequence of instructions 
executable by processor 312, for controUing the transfer of information (PDUs) between 
management processor 110 and switch 130. The architectural features of NIC 310 may also be 
found on the network interface cards 210 of each of the server appUances 101. 

Management server 110 sends management PDUs to and receives management PDUs 
fi-om server appliances 101. As discussed above, the management PDUs are generally related to 
the gathering and logging of various statistical information concerning network operation. In 
addition, however, management server 110 may transmit "non-management" or application 
PDUs such as file system information and software downloads to server appliances 101. Thus, 
management server 110 may send both management PDUs and application PDUs to other 
network devices through central switch 130. Similarly, server appliances 101 may send 
management PDUs to management server 110 (presumably in response to a management PDU 
received fi-om server 1 10) as well as application PDUs. 

Management PDUs typically comprise low-level data units transmitted between 
management server 110 and one or more device(s) that are locally connected on network 100. 
Management PDUs may travel between NIC 310 and the core 302 of management server 110 
over different logical paths. Whereas application PDUs must typically flow through an entire 
protocol stack, management PDUs are typically generated at the lowest levels of a stack. Using 
the example of web based services running on a TCP/IP network, application PDUs are 
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formatted to be TCP/IP compliant whereas management PDUs may have just a single header, 
such as a MAC header. FIG 4A illustrates an example of such a management PDU 401. As 
illustrated, management PDU 401 includes a management payload 412 and a MAC header 402 
specifying the physical address of the PDUs target. Because management PDUs are destined for 
local targets, they do not require the Internet address and other information provided by the 
higher levels of the protocol stack. 

Processor 312 of NIC 310 is configured to detect PDUs generated by management server 
110. Upon detecting a PDU, processor 312 may initially determine whether the PDU is a 
management PDU or an application PDU. An illustrative application PDU 403 is depicted in 
FIG 4B. In this example, application PDU 403 includes an application payload 410 and a 
TCP/IP compatible header structure including a TCP header 406, an IP header 404, and a MAC 
header 402. If the PDU is a management PDU, processor 312 may then determine whether there 
is an entry available in buffer 320 and store the management PDU in buffer 320 if there is an 
available entry. If there is no available entry in buffer 320, processor 312 may simply forward 
the management PDU to switch 130 without modification. Each management PDU typically 
includes payload information and a MAC header including a MAC address as discussed above 
indicating the server appliance or other device on network 100 to which the PDU is destined. 
Buffer 320 may be organized in a cache fashion where a PDUs MAC address is used as an index 
into buffer 320. In this embodiment, management PDUs are assigned entries in buffer 320 
according to their MAC address. This arrangement may simplify the task of later determining if 
buffer 320 contains a PDU destined for a specific device. Altematively, buffer 320 may 
comprise a random access memory in which a PDU associated with any target may be stored in 
any of the buffer entries. 

In addition to the MAC address, the MAC header of a management PDU may include an 
indication of the size of the PDU payload. As the payload size of a management PDU 
approaches the MTU of the network, the likelihood of combining the PDU with another PDU 
diminishes. One embodiment of the invention compares the size of an eligible management 
PDU to a maximimi PDU size. If the size of the management PDU is greater than or equal to the 
maximum size, the management PDU is fragmented if necessary and forwarded to switch 130 
without delay. If the management PDU is smaller than the maximum PDU size, NIC 310 will 
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attempt to save the PDU and combine it later with another PDU destined for the same network 
address. 

If processor 312 determines that a particular PDU is an application PDU, the processor 
may first determine whether the application PDU is an eligible application PDU (i.e., an 
5 application PDU with a size less than some predetermined maximum). If processor 312 
determines that a particular application PDU generated by management server 110 is an eligible 
appUcation PDU, processor 312 may then determine whether any management PDUs with the 
same target address are pending in buffer 320. As discussed previously, buffer 320 may be 
organized where the network address provides an index into buffer 320. In this embodiment, 
10 determining whether there is an eligible management PDU suitable for combining with an 
eligible application PDU is accomplished by determining whether an entry in buffer 320 
Q corresponding to the application PDU's target address contains a valid management PDU. In 
'!r^ any event, if NIC 320 detects a match between an eligible application PDU's target address and 
"'"'=1 the target address of a management PDU pending in buffer 320, NIC 3 10 is configured to modify 
1^1} the eligible application PDU to include the pay load of the management PDU. 
|!y Referring to FIG 4C, a conceptuaUzed depiction of a hybrid or modified PDU 405 

modified by NIC 310 according to the present invention is illustrated. Modified PDU 405 
111 typically includes a set of headers such as a MAC header 402, an IP header 404, and a TCP 
17^ header 406 similar to application PDU 403. In addition, however, modified PDU 405 may 
20=3 include a payload comprised of an application PDU payload 410 and a management PDU 
payload 412. Typically, one or more of the PDU headers includes information indicating the 
size of the payload. In an embodiment of the invention in which management payload 412 is 
appended to PDU 405 at a low-level of the protocol stack, the payload size information in MAC 
header 402 reflects the combined size of data payload 410 and management payload 412. For 
25 purposes of this disclosure, the low-levels of a protocol stack include the physical and data link 
layers as described in the Open Systems Interconnect (OSI) Reference Model developed by the 
Intemal Standards Organization. The physical and data link layers provide the transmission 
media and protocols for local communications. In contrast, the headers generated at higher 
levels in the protocol stack reflect only the size of data payload 410. Because headers such as IP 
30 header 404 and TCP header 406 are unaffected by the inclusion of management PDU 
information into an application PDU, the present invention is TCP/IP compatible. In other 
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words, modification of an existing protocol stack at only the lowest level is required to 
implement the invention. By confining the modifications required to implement the invention to 
the lowest levels of the protocol stack, the present invention is easily implemented and is 
compatible with standard TCP/IP networks. 



When a combined PDU such as modified PDU 405 is transmitted to a server appliance 
101 or other target on network 100, the NIC in the target device is configured to disassemble the 
combined PDU information into its component parts. More specifically with respect to the 
10 implementation discussed above, the target device NIC, such as the NIC 210 in each server 
appliance 101, is configured to strip off the management information from a modified PDU by 
comparing the PDU size information in MAC header 402 to the PDU size information contained 
■l^j in other headers such as TCP header 406 or IP header 404. The difference between the PDU size 
information in MAC header 402 and the PDU size information in the other headers represents 
liSJ the size of the management PDU payload that was appended to the PDU by NIC 310 of 
f"; J management server 110. 

The data link layer of each server appUance 101 is preferably configured to modify 
ry incoming PDUs that include both a management PDU payload as well as an application PDU 

n 

^ payload. Typically, NIC 210 modifies the received PDU by storing the management payload in 
2d3 a buffer (not depicted) and reconfiguring the PDU by stripping of the management payload and 
the MAC header. After this modification is complete, the PDU comprises a standard TCP/IP 
PDU with a single payload. This modified PDU can then be processed up the protocol stack in 
the conventional manner to retrieve the appropriate payload. 

The NIC 210 of each server appUance 101 may be configured similarly to the NIC 310 of 
25 management server 110. More specifically, each NIC 210 may include a buffer and a processor 
configured to store eligible management PDUs in the buffer until an eligible application PDU 
with the same destination address is detected. In an embodiment in which network management 
is centralized in a single, dedicated server such as management server 110, the destination 
address of each eUgible management PDU generated by servers 101 is typically the management 
30 server 1 10. Thus, the buffer of each NIC 210 may be considerably simpler than the buffer 320 of 
management server NIC 310 (which has to allocate entries for each network address and keep 
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track of the destination address). When a server appliance 101 generates an application PDU 
targeted for management server 110, NIC 210 v/iW determine if any management PDUs are 
pending in the NIC's buffer. NIC 210 will then attempt to generate a combined PDU similar to 
PDU 405 if there is a management PDU pending in its buffer. In the described manner, the 
5 present invention attempts to take advantage of the larger PDU sizes available on high bandwidth 
networks by maximizing the information that is carried in each PDU and reducing the size of 
each PDU. 

Turning now to FIG 5, a flow chart illustrating a method 500 of transferring information 
among servers in a computer network such as computer network 100 is depicted. Initially, a 
10 PDU generated by a server is detected (block 502) by the server's network interface card. The 
server may be the management server 110 depicted in FIG 1. Upon detecting a PDU, the 
Q server's NIC then determines whether the PDU is a management PDU (block 504). If a 
management PDU is detected, the NIC may compare (block 506) the size of the PDU to a 
'^1 predetermined maximum size. If the PDU size is greater than or equal to the maximum 
15 Q predetermined size, the PDU is considered to be too large to be combined with a non- 

■ff" management PDU and the management PDU is therefore simply forwarded (block 510) to its 

i y 

is network target. If the size of the management PDU is less than the maximum predetermined 
py size, the NIC determines if there is an available entry in a management PDU buffer such as 
;;'5f buffer 320 depicted in FIG 3. In one embodiment, determining whether an entry in the NIC 
2Q-3 buffer is available includes indexing the buffer using the network target's MAC address, which 
comprises a portion of the PDU's MAC header. 

If the NIC determines that there is no entry available in buffer 320, the packet is 
forwarded to its network target in block 510. If, however, there is an available entry in the NIC's 
buffer and the size of the PDU is less than the maximum predetermined size, the management 
25 PDU is stored (block 512) in the NIC buffer where it will await combination with a future non- 
management PDU destined for the same network target as the management PDU. 

If the NIC determines in block 504 that a PDU is an application PDU and not a 
management PDU, it then determines (block 514) whether the size of the PDU is less than the 
MTU of the network (i.e., whether the PDU is an eligible application PDU). If the data PDU is 
30 not an eligible PDU, the apphcation PDU is simply forwarded to its target over the network in 
block 518. If the apphcation PDU is an ehgible PDU, the NIC determines (block 516) whether 
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there is a management PDU currently stored in the NIC's buffer that has the same target address 
as the apphcation PDU. If there is no such management PDU in the buffer, the application PDU 
is forwarded to its target in block 518. If, however, a valid management PDU in the NIC's 
buffer is foimd to have the same target address as the application PDU, the NIC generates (block 
5 520) a combined or hybrid PDU by incorporating the management PDU payload into the 
application PDU. 

In one embodiment, the generation of the hybrid PDU may include determining whether 
the available space in the application PDU is sufficient to accommodate the management PDU 
that is stored in the buffer. The available space in the application PDU is generally the 

10 difference between the MTU and the size of the application PDU. If the size of the management 
PDU payload is less than this difference, then the entire management payload may be 

O incorporated into the hybrid PDU. If the management PDU payload is larger than the available 

hi} 

%4 space in the application PDU, the apphcation PDU may be forwarded without combination. 

;, a 

,R Typically, the generation of the hybrid PDU includes modifying the MAC header of the 

f K 

1-5=1 application PDU to reflect the increased size of the hybrid payload (i.e., the combination of the 
fU application PDU payload and the management PDU payload). Once the hybrid PDU is 
constructed in block 520, it is sent to the target device in block 520. 

Typically, each server appliance 101 includes a NIC roughly analogous in architectural 
design to the NIC 3 10 of management server 110. When a server appliance NIC receives a PDU 



ry 



2p^^ from the network, it may first determine whether the PDU originated from management server 
110. If an incoming PDU came from management server 110, the apphance server NIC may 
determine whether the PDU is a hybrid PDU by comparing the payload size indicated by the 
MAC header with the payload size indicated by one or more of the other headers including the 
TCP header and/or the IP header. When an appliance server NIC discovers a hybrid PDU, it 

25 may first strip off the management payload from the packet (again based on payload size 
difference information in the PDU headers). It can then process the management information 
separately from the application information as appropriate. 

When an appliance server 101 returns management information to management server 
110 such as in response to a management server request, the process described above may be 

30 substantially reversed. More specifically, the appliance server NIC may include a buffer used to 
store management PDUs. If a management PDU meets predetermined size criteria, the appliance 
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server NIC may store the management PDU in its buffer. When the appliance server eventually 
generates an application PDU with the management server 110 as a target, the server appliance 
NIC may attempt to combine a buffered management PDU with the application PDU prior to 
sending the PDU back to the management server. In this manner, one embodiment of the 
5 invention reduces bandwidth consumption attributable to management PDUs. 

Turning now to FIG 6 and FIG 7, selected features of network 100 are presented to 
illustrate an embodiment of the invention configured to simplify and automate the periodic 
gathering of management information on network 100. Historically in network environments, 
gathering of management information is accomplished by programming each host processor to 
10 set an alarm. When the alarm activated, management information is transmitted in the same 
maimer as application packets are transmitted (i.e., using the application PDU protocol stack). 
O Unfortunately, such an implementation results in overhead that is subject to numerous delays due 

i. i i 

to the nature of protocol stacks and the behavior of Ethernet and other networks. 

One embodiment of the present invention addresses this problem by providing a system 



14^^! and method for automatically gathering management information on a data processing network, 
ry Generally speaking, the invention provides a low-level, timed packet polling scheme that 
leverages the programmability and typically substantial storage capacity of the network interface 
iti cards of each device on the network. Typically, the management information under 
rq consideration is well defined and available either locally at the NIC or capable of being written 
20."'': directly to the NIC by the corresponding host processor. This information is then accumulated in 



a dedicated buffer on the NIC. Periodically, a locally attached system or device (i.e., a system or 
device that is on the same sub-net) issues a low-level request for management information. The 
request may be sent to a specific device or globally to each of the devices on the local network. 
Each system targeted by the information request responds by transmitting a PDU containing the 
25 contents of the buffer back to the address associated with the information request and clearing 
the buffer. 

In an embodiment illustrated in FIG 6, the network device assigned responsibility for 
issuing the periodic information requests is the NIC 310 of the dedicated management server 110 
discussed above with respect to FIG 1. In this embodiment, NIC 310 may include a timer 330 
30 that is connected to processor 312. Timer 330 may be programmed with a predetermined time 
interval depending upon the fi-equency at which the management information is to be gathered. 
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When the predetermined interval expires, timer 330 may interrupt processor 312 to initiate the 
request for information. In response to such an interrupt from timer 330, processor 312 
generates and issues a low-level polling request (i.e., a request issued at the data link layer). In 
one embodiment, for example, the polling request issued by processor 312 includes a data link 
layer header, including a MAC header, that includes the network address of one or more target 
devices, but does not include additional protocol headers such as the network and transport layer 
headers. Since management server 110 and each of the server appliances 101 comprise a portion 
of a single LAN, the data link layer is sufficient to imiquely identify the network address. In this 
embodiment, the format of the polling request is similar to the format of the PDU 401 depicted in 
FIG4A. 

The NIC 210 of each target device on network 100 that receives the polUng request from 
NIC 310 includes a processor 212 connected to a storage device such as buffer 220. In this 
embodiment, the buffer 220 may be dedicated for the storage of the management information. 
As management information is generated by each NIC 210 or received by each NIC 210 from its 
corresponding host processor (not depicted), the information is stored in buffer 220. Upon 
receiving the polling request PDU, each processor 212 responds by generating a responsive PDU 
that includes the network address of the device that issued the polling request (i.e., the address of 
NIC 310) and all or a portion of the information stored in buffer 220. These PDUs are then 
delivered to NIC 310 via switch 130. 

When NIC 310 receives responses from all of the devices targeted by the polling request, 
the management information contained in each of the responsive PDUs may be copied to a 
predetermined area of host storage. NIC 310 may then interrupt its host processor where further 
processing of the management information can be performed. By substantially delegating the 
generation of the polling requests to NIC 310, this embodiment of the invention beneficially 
enables the host processor of management server 110 to concentrate on other tasks such as the 
analysis and display of the management information. In addition, the use of low level PDUs that 
are not required to travel up and down entire protocol stacks results in the efficient gathering of 
management information on a periodic basis, 

FIG 7 is a pair of flow charts illustrating a method 700 for the automated polling of 
information in a data processing network such as network 100. The flow chart on the left side of 
FIG 7 represents operation of the management server 110 while the flow chart on the right 
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represents the operation of each of the systems targeted by the polling request. These targeted 
devices may represent the server appliances 101 as depicted in FIG 1. Initially, management 
server 110 and the target systems are in an operational mode. Upon detecting an interrupt from a 
timer (block 702), management server 110 generates (block 704) a polling request which is 
5 preferably a low-level request as described above. This polling request may actually represent a 
distinct polling request for each targeted system or, more preferably, a single polling request that 
is globally broadcast to each system that is locally attached to management server 110 (i.e., 
attached directly to central switch 130). After the polling request is generated, management 
server 110 then transmits (block 706) the request to the targeted devices and enters a loop in 
10 which it awaits responses from each of the targeted devices. 

Simultaneously with the operation of management server 110, the targeted systems are in 
O an operational mode. As part of this operational mode, the targeted devices are accumulating 
(block 712) management information in a special purpose buffer. When a polling request from 
J management server 110 is detected (block 714), each targeted system generates (block 716) a 
ISaI PDU that is responsive to the polling request. More specifically, the responsive PDU generated 
I'y by each targeted system is a low-level PDU that includes a header containing the destination 

•] address of the requesting device (typically the management server 110) and a payload including 

0 

\U at least part of the accumulated management information. After generating the responsive PDU, 

; 3 

^ each targeted device then transmits (block 718) the PDU back to the requestor and clears (block 

20Ul 720) the accumulated information from its buffer. 

After sending the polling request in block 706, the management server waits until 
responses are received from each of the targeted systems. Upon determining (block 708) that 
responses have been received from each targeted system, the management server can then store 
(block 710) the retrieved information to its host system's memory and interrupt the host. The 

25 management server host may then process the retrieved information as needed. In the preferred 
embodiment, each of the blocks illustrated on the management server side of FIG 7 is preferably 
delegated to the management server's NIC 310. In this manner, the periodic retrieval of 
management information occurs without any significant participation by the management server 
host. Moreover, because NIC 310 is able to communicate with the NICs of the targeted systems 

30 at a physical level, polling and responses can occur at the lowest level of the network's 
communication protocol thereby improving the efficiency of the process. 
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Turning now to FIGs 8A, 8B, and 9, an embodiment of the invention emphasizing the 
ability to re-order or prioritize PDUs is illustrated. Traditionally, enforcement of packet 
transmission and reception priorities has been difficult even on a single physical subnet. The 
development of standards with defined priority bits, such as IEEE 802. Iq detailing the Virtual 
5 LAN (VLAN) standard, presents the opportunity to implement a priority enhanced network 
interface card. The priority mechanism can supplement the use of an interrupt coalescence 
scheme to optimize the manner in which a host processor handles interrupts. 

Despite improvements in interrupt handling routines and the advent of long PDUs such as 
the jumbo PDUs of 1 GBit Ethernet, the host performance penalty associated with generating 
10 firequent interrupts is generally unacceptable given the speed at which modem processors are 
capable of executing. Interrupt coalescence has evolved to reduce the number of interrupts that 
□ are issued to a host processor by its NIC. Interrupt coalescence typically includes some form of 
\i buffering two or more PDUs and later processing all or at least a portion of the buffered PDUs 
^ ^ With a single host processor interrupt. One embodiment of the present invention extends the 
1 interrupt coalescence scheme with prioritization to optimize the interrupt techniques. 
j"y Referring now to FIG 8A and 8B, conceptual diagrams illustrating the format of a PDU 

'^^ suitable for implementing the priority handling described herein according to one embodiment of 

rU the invention are presented. In the depicted embodiment, a PDU 800 includes a target system 

C3 

rq field 802, which typically contains the MAC address of a targeted device or devices and a 
20;=^ type/length field 804. The type/length field 804 may be suitable for implementing a VLAN 
network in which multiple logical LAN's may be defined on a single physical medium. In the 
embodiment fiirther illustrated in FIG 8B, the type/length field 804 includes a VLAN identifier 
(VID) field 812 and a priority field 810. In the depicted embodiment, which is compatible with 
the VLAN implementation specified in IEEE 802. Iq, the VID field 812 includes 12 bits and is 
25 capable of specifying as many as 4K virtual LANs. The priority field 810 may include three bits 
and is capable of specifying a PDU priority of 0 to 7. 

Referring to FIG 9, a conceptual illustration of a buffer 900 suitable for use with the PDU 
prioritization scheme described herein is presented. Buffer 900 is a storage device that is 
typically located on a NIC of a network device. Thus, buffer 900 may comprise all or a portion 
30 of the buffer 320 depicted in FIG 3 or the buffer 220 of a server appUance 101 as depicted in FIG 
6. Buffer 900 is logically divided into a plurality of entries 902 (two of which are identified in 



roM.5229 18 ^^DocketNo.: AUS920000522US1 



FIG 9 by reference numerals 902-1 and 902-2). Each buffer entry 902 is suitable for storing a 
PDU that has been received from or is destined for another device on network 100. Each of the 
PDUs stored in an entry 902 of buffer 900 includes a priority field 810 and a data field 811. In 
one embodiment of the invention, management PDUs are differentiated from application PDUs 
5 by a differentiation in the corresponding entry's priority field 810. As illustrated in FIG 9, the 
priority field 810 of a management PDU such as the management PDU depicted in entry 902-1 
may be assigned a first value such as 001b while the priority field 810 of an application PDU 
(entry 902-2) may be assigned a second value such as 010b. By using the priority field provided 
by the network protocol specification to differentiate between management information and 
10 application information, this embodiment of the invention enables the NIC to provide interrupts 
to the corresponding host selectively depending upon the type of the buffered transaction. 
Q In one embodiment, for example, the NIC 220 of a server appliance 101 may include a 

table indicating the number of PDUs that may be coalesced before an interrupt is issued to the 
H server appliance's host processor 212. This table may include different values for each priority 
15i y type such that high priority PDUs may cause relatively more frequent interrupts whereas low 
g priority PDUs cause relatively less frequent interrupts. Thus, for example, NIC 210 of server 

!3 appliance 101 may generate a host processor interrupt for each application PDU it receives, but 

Q 

ry only generate a host processor interrupt after it has accumulated multiple management PDUs. In 
this manner, the number of host processor interrupts is reduced in a manner that accounts for the 
20 □ priority of the corresponding PDUs. 

( 

The buffer 900 may represent a buffer of PDUs that are ready to be sent onto the network 
rather than a buffer of received PDUs. In this embodiment, the priority field data may be used to 
prioritize the order in which PDUs are transmitted across the network. In this embodiment, the 
order in which PDUs are stored in buffer 900 does not necessarily indicate the order in which 

25 they are forwarded onto the network. Instead, the priority field data may take precedence over 
the sequential order in which the PDUs are generated. Referring again to an example in which 
application PDUs receive a higher priority value than management PDUs, appUcation PDUs may 
be forwarded to the network quickly while management PDUs are permitted to reside in buffer 
900 for a longer duration. In this maimer, the transmission of management PDUs can be tailored 

30 to minimize the bandwidth and performance impact. The management PDUs could, as an 
example, accxmiulate in buffer 900 until the corresponding NIC senses a lapse in the nimiber of 
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application packets being transmitted. In at least some applications, a lack of PDU activity 
during a particular time period is a good predictor that there will be a similar lack of activity 
during a subsequent time period. When the NIC detects such a lapse, it could make the 
assumption that there is not likely to be any application PDU information in the immediate future 
5 and take the time to forward any pending management PDUs during that period. 

It will be apparent to those skilled in the art having the benefit of this disclosure that the 
present invention contemplates a system and method for implementing larger PDUs in a network 
to minimize bandwidth consumption and facilitate the transmission of network management 
PDUs over the same physical network as application and application PDUs. It is understood that 
10 the form of the invention shown and described in the detailed description and the drawings are to 
be taken merely as presently preferred examples. It is intended that the following claims be 
O interpreted broadly to embrace all the variations of the preferred embodiments disclosed 
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